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Abstract 

Multi-way tables with specified marginals arise in a variety of applications in statistics 
and operations research. We provide a comprehensive complexity classification of three 
fundamental computational problems on tables: existence, counting and entry-security. 

One major outcome of our work is that each of the following problems is intractable al- 
ready for "slim" 3-tables, with constant and smallest possible number 3 of rows: (1) deciding 
existence of 3-tables with given consistent 2-marginals; (2) counting all 3-tables with given 

2- marginals; (3) finding whether an integer value is attained in entry k) by at least one 
of the 3-tables satisfying given (feasible) 2-marginals. This implies that a characterization of 
feasible marginals for such slim tables, sought by much recent research, is unlikely to exist. 

Another important consequence of our study is a systematic efficient way of embedding 
the set of 3-tables satisfying any given 1-marginals and entry upper bounds in a set of slim 

3- tables satisfying suitable 2-marginals with no entry bounds. This provides a valuable tool 
for studying multi-index transportation problems and multi-index transportation polytopes. 

keywords: Contingency tables, multiway statistical tables, data security, statistical disclo- 
sure control, Frechet Bounds, confidentiality, transportation polytopes, marginal statistics, data 
quality, computational complexity. 

1 Introduction 

A d-table of size (m, . . . ,na) is an array of nonnegative integers v = (t>i lv ..,i d ), 1 < ij < rij. 
For < m < d, an m-marginal of v is any of the ( ) possible m-tables obtained by summing 
the entries over all but m indices. For instance, if (vij is a 3-table then its O-marginal is 
v +,+,+ = Yh=\ Efcli Vi,j,k, its 1-marginals are («»,+,+) = (Ej=i Efcli v i,j,k) and likewise 
(v +t j j+ ), (v +t+)k ), and its 2-marginals are (v itjt+ ) = (J2k=l v hi,k) an d likewise («*,+,&), 

Such tables appear naturally in statistics and operations research under various names such as 
multi-way contingency tables, transportation matrices, or tabular data. In all these applications, 
the tables of interest are those satisfying various constraints such as specified marginals or 
specified upper and lower bounds on the various table entries. Tables are central products of 
statistical agencies (for example, see the site of the U.S Bureau of Census). 

In this article we study three essential computational problems of constrained tables, pri- 
marily motivated by applications in statistical analysis and statistical data security (see e.g. 
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|], 11, 14] and references therein): the table existence or feasibility problem, the ta- 
ble counting problem and the table entry-security problem. We provide comprehensive 
computational complexity classifications of these problems, which are discussed, respectively in 
Subsections 1.1-1.3 below, where we make the precise definition, include a briefing on the mo- 
tivating statistical background, and describe our results for each problem. On the way we also 
show that the set of 3-tables satisfying any given 1-marginals and upper bounds on entries can be 
embedded in a set of "slim" 3-tables satisfying suitable 2-marginals with no entry bounds; this 
is discussed further, with the implications for the class of so-called multi-index transportation 
polytopes (cf. |2^, P8fl ) in Subsection 1.4 below. 

We demonstrate that even slim 3-tables, of size (3, c, h), having fixed number 3 of rows, can 
have an arbitrarily complex behavior. This improves on earlier results of Irving and Jerrum |20| |. 
For statisticians and agencies manipulating tabular data our results have practical repercussions: 
polynomial time algorithms for solving any one of the problems (feasibility, counting, or entry- 
security) are unlikely to exist. Thus, in taming 2-marginals arising in practice it will be necessary 
to exploit particular features of the real data in each specific application. 

Our results on the intractability of slim 3-tables stand in contrast with the efficient methods 



available for 2- way contingency tables (see [16, 17 1) and for the so-called decomposable-graph 



log-linear-models |i0|, [T4| , |18|| . Thus, we settle a problem that has been the focus of much recent 
research (see |], [Ll|, [25|1 and further references therein), on trying to find efficient methods for 
slim 3-tables, and demonstrate that already the 3-tables of smallest possible size (3, c, h) which 
are not decomposable-graph-log-linear-models can have an arbitrarily complex behavior. 

Finally, we point out that our results on the intractability of 2-marginals in 3-tables obviously 
extend to higher dimensions as 2-marginals in 3-tables can be embedded in higher dimensions. 

1.1 Table existence or feasibility 

First, we consider the table existence problem, also called the feasibility problem (cf. 
|Q, |28|): Given a prescribed collection of marginals that seem to describe a d-table of size 
(rii, . . . ,n,j), does there really exist a table with these marginals (and can it be effectively deter- 
mined) ? This problem is relevant for statistical analysis; for instance, disclosed or transmitted 
marginals may become perturbed or distorted in such a way that a feasible table may no longer 
exist, in which case, not only the data looses utility to the users, but also algorithms such as 
the iterative proportional fitting can fail to converge. This can be a problem because several 



statistical procedures are insensitive to existence, e.g. Frechet type bounds presented in [14]. 
See H|, H for a discussion of the importance of table existence in statistics applications. An 
obvious necessary condition for the existence of a table with a specified collection of marginals 
is that the collection is consistent, that is, any two given marginals must agree on any of their 
common lower dimensional marginals. For instance, for the existence of a 3-table with speci- 
fied 2-marginals (vij } +) and (uj + fc), these marginals must agree on their common 1-marginal 
(vi )+j _i_), so the 1-table equation (2j=l v i,j,+) = (J2k=i v i,+,k) must hold. In general, however, 
these consistency equations do not even guarantee the existence of an array with nonnegative 
real entries (cf . |23], [28j ) . 

The existence problem is easy to solve for 2-tables or 1-marginals, so the first really interesting 
case is that of 3-tables with all 2-marginals specified. The following theorem provides an almost 
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complete classification of the complexity of this problem. We assume without loss of generality 
that the size (r, c, h) of the tables satisfies 3 < r < c < h: for r < 2 the problem reduces to 
the well-studied case of 2-dimensional tables and can be solved in polynomial time using linear 
programming over the corresponding transportation polytope: see further discussion of these 
polytopes and their higher dimensional multi-index generalizations in Subsection 1.4 below. 



Theorem 1.1 The computational complexity of the existence problem for 3 -tables of size (r,c,/i) 
with 3 < r < c < h and all 2-marginals specified is provided by the following table: 





r, c, h fixed 


r, c fixed, h variable 


r fixed, c, h variable 


r, c, h variable 


unary 2-marginals 


P 


P 


NPC 


NPC 


binary 2-marginals 


P 


Q 


NPC 


NPC 



Each entry (i, j) of this table (i = 1, 2, j = 1, 2, 3, 4) represents a refined version of the existence 
problem; any problem (2, j) is at least as hard as the problem (l,j) below it, and for j > 2, 
any problem is at least as hard as the problem (i,j — 1) to its left. Here NPC stands for 
NP- complete hence presumably intractable and practically unsolvable for large inputs (cf. flTsfl ), 
whereas P stands for polynomial time hence efficiently solvable. Binary versus unary are the 
two standard ways of encoding numbers: for binary marginals, the size of each marginal is taken 
to be the number of digits in its binary (or decimal) expansion hence is proportional to its 
logarithm, whereas for unary marginals, the size of each marginal is the marginal itself. 

Thus, some of the entries follow at once from others, but are included for complete classifi- 
cation. Entry (1, 1) easily follows from exhaustive search. However, already entry (2, 1) requires 
the sophisticated algorithm of Lenstra for integer programming in fixed dimension |24]] : it would 
be interesting to device a special faster polynomial time algorithm for this entry. In Section 3 we 
shall prove entry (1,2), that is, the polynomial time solvability of existence for unary marginals 
with r, c fixed ("small") and h variable ("large"). In Section 2 we shall establish entries (1, 3) and 
(2, 3), that is, the NP-completeness of existence for marginals with r = 3 fixed and c, h variable. 
This implies at once entries (1,4) and (2, 4) in the right column established previously by Irving 
and Jerrum [20], strengthening their results. Entry (2,2) remains unsettled and challenging. 



1.2 Table counting 

Next, we consider the table counting problem: given a prescribed collection of marginals, 
how many d-tables are there that share these marginals ? Table counting has several applica- 
tions in statistical analysis, in particular independence testing, and has been the focus of much 
research (see [Q, pi ^] and the extensive list of references therein). The counting problem can 
be formulated as that of counting the number of integer points in the associated multi-index 
transportation polytope (see further discussion in Subsection 1.4 below). The following analogue 
of Theorem [O] provides a complete classification of the complexity of this problem. 

Theorem 1.2 The computational complexity of the counting problem for 3-tables of size (r, c, h) 
with 2 < r < c < h and all 2-marginals specified is provided by the following table: 
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r, c, h fixed 


r, c fixed, h variable 


r fixed, c, h variable 


r, c, h variable 


unary 2-marginals 


P 


P 


#PC 


#PC 


binary 2-marginals 


P 


#PC 


#PC 


#PC 



Here #PC stands for #P-complete, hence presumably intractable; see Valiant's seminal paper 
[27] which introduces the complexity theory of counting, or consult Pq| . 

Entry (1, 1) is easy, but already entry (2, 1) requires the sophisticated algorithm of Barvinok 
for counting integer points in polytopes in fixed dimension In Section 3 we prove entry (1, 2), 
that is, counting in polynomial time for unary marginals with r, c fixed and h variable. Entry 
(2, 2) follows from the #P-completeness of counting 2-tables of size (2, n) with binary marginals 
|l2| . In Section 3 we also prove entry (1, 3), that is, the #P-completeness of counting for unary 
marginals with r = 2 fixed and c, h variable, implying entries (2,3), (1,4) and (2,4) as well. 



1.3 Table entry-security 

The third problem we consider arises in the context of secure and confidential disclosure of 
public statistical data (see || 11, 14] and references therein). The goal in this context is the 
release of some marginals of a table in the database but not the table's entries themselves. If 
the range of possible values that an entry Xij & can attain in any table satisfying the released 
collection of marginals is too narrow, or even worse, consists of the unique value of that entry in 
the actual table in the database, then this entry may be exposed. This shows the importance of 
determining tight integer upper and lower bounds of each entry We consider the following 

lower and upper versions of this problem, the table entry-security problem: let there be given 
a feasible prescribed collection of 2-marginals (i.e., admitting at least one feasible d-table) and 
an index tuple (ii, ... Given now also a nonnegative integer L, is there a d-table x having 
the given marginals whose entry X{ x i . is greater than or equal to L (lower version) ? or the 
analogous question, given now also a nonnegative integer U, is there a d-table x having the given 
marginals whose entry ... i , is less than or equal to U (upper version) ? 
There is an extensive work on the entry-security problem, see e.g. | 



14, 25 



|, where 

properties are sought that may help address the problem. The paper surveys the state- 
of-the-art research and practical techniques. The following analogue of Theorems |1.1| and |1.2j 
provides an almost complete classification of the complexity of the entry-security problem as 
well. 

Theorem 1.3 The complexity of both lower and upper versions of the entry-security problem 
for 3-tables of size (r, c, h) with 4 < r < c < h and all 2-marginals specified is provided by: 





r, c, h fixed 


r, c fixed, h variable 


r fixed, c, h variable 


r, c, h variable 


unary 2-marginals 


P 


P 


NPC 


NPC 


binary 2-marginals 


P 


9 


NPC 


NPC 



Once again, entry (1,1) is easy and entry (2,1) follows from [24]. In Section 4 we prove the 
polynomial time solvability for the case of unary marginals with r, c fixed and h variable (entry 
(1, 2), and the intractability for r fixed and c, h variable (entries (1, 3) and (2, 3), strengthening 
earlier hardness results of Irving and Jerrum [20] reflected in entries (1,4) and (2,4). Again, 
entry (2, 2) remains unsettled. 
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1.4 Multi-index transportation polytopes and the power of two-marginals 

Given a specified collection of marginals for d-tables of size (ni, . . . , rid), possibly together with 
specified lower and upper bounds on some of the table entries, the associated multi-index trans- 
portation polytope is the set of all nonnegative real valued arrays satisfying these marginals and 
entry bounds (cf. [§3|), and is a (typically bounded) convex polyhedron in R ni "' nd . For instance, 
for 2-tables of size (n, n) with all 1-marginals equal to 1 and no entry bounds, this is the Birkhoff 
polytope of n by n bistochastic matrices. The (i-tables satisfying the given marginals and entry 
bounds are precisely the integer points in the associated multi-index transportation polytope. 

In Section 5 we show how a system of 1-marginal and entry upper bound constraints on 
3-tables can be embedded into a system of 2-marginal constraints (with no entry bounds) on 
"slim" 3-tables, demonstrating the expressive power of 2-marginals and reducing the existence, 
counting and entry-security problems for 1-marginals with upper bounds to that for 2-marginals 
with no upper bounds in slim tables. We prove the following somewhat technical statement. 

Theorem 1.4 Given 1-marginals (nj. +j+ ), (ti +Jj+ ), (u + 4^) and entry upper bounds (pij t k) f or 
3-tables of size (r,c,h), there exist polynomial time constructible 2-marginals (vij+), {vi + k), 
(v +i j } k) for 3-tables of size (3, rc, r + c + h) such that the set of nonnegative real (r, c, h) -arrays 
with the given upper bounds and 1-marginals is in integer preserving affine bisection with the set 
of nonnegative real (3,rc,r + c+ h) -arrays with the constructed 2-marginals. 

A particularly appealing outcome of our constructions is the systematic derivation of "real- 
feasible-integer-infeasible" collections of 2-marginals, admitting nonnegative real 3-arrays but 
no (integer) 3-tables. Remarkably, we can "automatically" obtain the 2-marginals for 3-tables 



of size (3, 4, 6), discovered by Vlach [28, page 77] (see our Example 2.2). We obtain it from very 
simple {0, l}-valued 1-marginals and entry upper bounds for 3-tables of size (2, 2, 2). Applying 
to them the constructions of this paper yields precisely the collection of {0, l}-valued 2-marginals 
discovered by Vlach. 

We conclude this introduction with some final discussion. First, we refer to the open problems 
left in the (2, 2) entries of Theorems |1.1| and |L^. Consider the set of 3-tables v of size (r, c, h) with 
r, c fixed satisfying specified marginals (v^+fi) and (v + j t k) but without restriction on the marginal 
(vij t+ ). The projection ~R T " c ' h — > R r ' c : v 1— > = J2k=i v i-j,k sends the associated multi- 

index transportation polytope onto a subpolytope P of the transportation polytope of all 2- 
tables of size (r, c) with 1-marginals (1*1,4) := (1^+,+) and (u + j) := (v +i j t+ ). The techniques 
of [jl], |l^, ^2| allow to produce the vertices of P in polynomial time and check if any given 
"vertical" marginal (vi j 4.) lies in P, which is a necessary condition for the existence of a 3-table 
with (v + j t k) and (vij j+ ). Further development of the methods of jl], [2|, [L9|, 22] combined 



with integer programming in fixed dimension might help in addressing these remaining problems. 

Although our results stress the complexity of handling even small and slim 3-way tables for 
statistical applications, recent results using special structure in specific systems may make such 
table systems amenable to geometric algorithms for practical computations. For example, in 
n, 10, lq] the specified marginals satisfies a hierarchical structure of certain graphical models in 



statistics. Other approaches include the new generation of algebraic and randomized algorithms 
[l2|], which will allow, in practice, faster computations for increasingly larger problems. 
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2 The table existence problem 



In this section we provide the proof of Theorem |1.1| discussed in Subsection 1.1, and demonstrate 
our constructions with some examples. In particular, as explained in the introduction, using 
our construction we recover the smallest possible real-feasible-integer-infeasible collection of 2- 
marginals of 3-tables of size (3, 4, 6). 



Proof of Theorem 1.1. As explained in Subsection 1.1, entry (1,1) of the complexity table 
claimed by the Theorem is easy and entry (2, 1) follows from [24]. Entry (1, 2) follows from entry 



(1, 2) in the table of Theorem 1.2 which will be proved in the next section: indeed, we shall show 
in Section 3 how to compute in polynomial time the number of 3-tables of size (r, c, h) with r, c 
fixed satisfying given 2-marginals in unary, and hence in particular to decide if this number is 
zero or not, providing a solution of the existence problem as well. 

We need then prove entry (1, 3) of the table, which implies at once entries (2, 3), (1, 4), (2, 4) 
as well. It is easy to see that the well-known 3-dimensional matching problem (cf. |l5| ) is 
equivalent to the following problem: given a {0, l}-valued 3-table p = (pi,j,k) of size (n,n, n), is 
there a 3-table x = (x^j^) with all 1-marginals equal to 1 which is dominated by p, i.e. satisfies 
the upper bounds < Pi,j,k for all i, j, k ? we reduce this problem to ours, which is clearly in 
NP. Let then p = (pij t k) be a given {0, l}-valued 3-table of size (n,n,n). We define efficiently 
constructible 2-marginals for (3, n 2 , 3n)-tables such that nonnegative real arrays y with these 
marginals are in integer preserving affine bijection with nonnegative real (n, n, n)-arrays x with 
all 1-marginals equal to 1 dominated by p. For clarity, the table will be indexed by triplets of 
special form which we now explain. The first index will be an integer 1 < t < 3. The second 
index will be an ordered pair ij with 1 < i, j < n. The third index will belong into one of three 
groups - "domination" group, "row" group and "column" group, and will consist of one of three 
three-letter abbreviations g ro € {d om . row . col } according to the group it belongs to, along with a 
numerical index 1 < k < n. The 2-marginals are provided by the following three matrices. 



11 



12 



In 



21 



22 



2n 



nl 



n2 



nn 



j, g TO k J 



dom n 

row 1 
row 2 

row n 

col 1 
col 2 

coi n 



/ Pi, 1,1 Pl,2,l 
Pi, 1,2 Pl,2,2 



Pl,l,n Pl,2,n 



1 





1 


V o 



1 











1 



Pl,n,l P2,l,l P2,2,l 
Pl,n,2 P2,l,2 P2,2,2 

Pl,n,n P2,l,n P2,2,n 




1 



1 





P2,n,l 
P2,n,2 

P2,n,n 



1 








Pn,l,l Pn,2,l 
Pn,l,2 Pn,2,2 

Pn,l,n Pn,2,n 



Pn,n,l \ 
Pn,n,2 

Pn,n,n 









1 J 
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11 


12 


In 


21 


22 


2n 


nl 


n2 


nn 


1 


/ 1 


1 


1 


1 


1 


1 


1 


1 


1 


2 






• • Pl,n,+ 




P2,2,+ ■ 




' ' Pn,l,+ 


Pn,2,+ • 




3 


I 1 


1 


1 


1 


1 


1 


1 


1 


1 




m \ 



n - 1/ 



First consider any nonnegative real (n, n, n)-array x dominated by p with all 1-marginals equal 
1. We show it uniquely extends to a nonnegative real (3, n 2 , 3n)-array with 2-marginals as above. 
It will be convenient to keep in mind a partition of (3, n 2 , 3n)-arrays into blocks as in Figure [l|. 



ROW 



COL 




Figure 1: Block partition of (3, n 2 , 3n)-arrays. 



Given then such an array x, embed it in the black block (l,dom) of a (3, n 2 , 3n)-array y by 

yi,ij,domk := x i,j,k j 1 ^ h ji k < n . 
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We now show that the block x can be uniquely extended to a whole nonnegative real (3, n 2 , 3n)- 
array y with the above 2-marginals. First consider the entries in the grey blocks (1, ooi), (2, row) 
and (3, dom) in Figure |l|: since Ui,+, co ifc = L>2,+,rowfc = ^3,+,domfc = for all k, it follows that all 
the entries y\ : ij. col k, V2,ij,iomk an d 2/3,i.7,domfc constituting these blocks are zero. Next, consider the 
entries in the white block (l,row): using the fact just established that all entries in the block 
(l,coi) below it are zero, and examining the 2-marginals f+,ij,rowfc and vi,ij,+ = 1, we find that 
yi,y>owi = 1 - Efe=i2/i,ij,domfc = 1 - > whereas for k ^ i we have yi )ij)Iovk = 0. This 

also yields the entries in the white block (3, row): we have 2/3,2 i 7,row2 — 1 — 2/1,27, row % — x ij,-\- — ^ 
whereas for k 7^ i we have 2/3,27, row fc = 0- Next, consider the entries in the white block (2, dom): 
using the fact that all entries in the block (3, dom) to its right are zero, and examining the 

2- marginals v + ^ Aouik = Pi,j,k we find that y2,ij,domk = Pi,j,k ~ x ij,k > for all i,j,k. Next 
consider the entries in the white block (2, co i): using the fact that all entries in the block 
(2, row) above it are zero, and examining the 2-marginals f+,ij. co ifc and V2%j + = Pi.j,+ , we find 
that y2,ij,coij = Pi,j,+ ~ Efc=i 2/2,ij,domfc = Xi,j,+ > whereas for k ^ j we have y 2 ,ij, ca ik = 0. This 
also yields the entries in the white block (3, coi): we have j/3y co ij = 1 — 2/2ij,coij = 1 — x ij+ ^ 
whereas for k ^ j we have yz^j^oik = 0. 

Next consider any nonnegative real (3, n 2 , 3n)-array y with the above 2-marginals, and let x 
be its (n, n, n)-subarray given by the black block (l,dom) of y, defined by := 2/1 y dom* for 
all i,j, k. We show that x is nonnegative, dominated by p and has all 1-marginals equal to 1. 
It is nonnegative since so is y. It is dominated by p since, for all i, j, k we have Pij t k ~ x i,j,k = 
2/2, ij, dom k — 0- Finally, all the 1-marginals of x are equal to 1 since: 

X +, + ,k ^ ' 2/1,2.7, dom k 

ij 

x i,+,+ = ^ t 2/3, i 7, row i 
j 

X +,j,+ = ^ 2/2,i,7,colj 
i 

Thus, the set of nonnegative real (n, n, n)-arrays x dominated by p and with all 1-marginals 1 
is in integer preserving affine bijection with the set of nonnegative real (3, n 2 , 3n)-arrays y with 
the constructed 2-marginals. In particular, the corresponding sets of tables are in bijection and 
therefore the former is nonempty if and only if the latter is. This completes the reduction of 

3- dimensional matching to our problem, the proof of entry (1, 3) and the proof of Theorem [O]. □ 

The following two examples illustrate our construction. 
Example 2.1 Let n = 2 and let p be the {0, 1} valued 3-table of size (2, 2, 2) given by: 

Pi, 1,1 = 1, Pl,2,l = 1, P2,l,l = 0, p 2 ,2,l = 0, ^1,1,2 = 1, Pl.2,2 = 1, P2,l,2 = 0, £> 2 ,2,2 = 1 • 

Our construction yields the 2-marginals for 3-tables of size (3, 4, 6) presented in Figure ^. 
The unique 3-table x with all 1-marginals equal to 1 which is dominated by p is given by: 



ui,+,domfe = 1 1 1 <k <n ; 

«3,+,rowi = 1 , 1 < i < n ; 
«2,+,coi 3 = 1, 1 < J < n . 



£1,1,1 = 1, Xi, 2 ,l = 0, £2,1,1 = 0, £2,2,1 = 0, £1,1,2 = 0, £i, 2 ,2 = 0, £ 2 ,1,2 = 0, £ 2 ,2,2 = 1 , 
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Figure 2: The 2-marginals i4-,y jgro fc, ^i,+,gro&j v t,ij,+ constructed in Example ^4 



and the corresponding 3-table y with the above 2-marginals is given by the following blocks: 



Ul,ij,gTo k 

11 12 21 




U2,ij,gro k 

11 12 21 



2/3,ij',gro k 

11 12 21 22 




As pointed out in the introduction, our construction can be used to systematically obtain 
"real-nonempty-integer-empty" multi-index transportation polytopes, namely, collections of 2- 
marginals admitting nonnegative real 3-arrays but no (integer) 3-tables. In particular, we next 
recover the smallest such example, first discovered by Vlach [ffijfl , as follows. 

Example 2.2 Let again n = 2 and let p be the {0, 1} valued 3-table of size (2, 2, 2) given by: 

Pi, 1,1 = 1> Pl,2,l = 0, P2,l,l = °> P2,2,l = 1, Pl,l,2 = 0, Pl j2 ,2 = 1, P2,l,2 = 1, P2,2,2 = . 

Our construction yields the 2-marginals for 3-tables of size (3, 4, 6) presented in Figure ||. 

It can be verified that there is a single nonnegative real array of size (2, 2, 2) with all 1-marginals 
equal to 1 which is dominated by the upper-bound table p. All entries of this array are {0, ^}- 
valued and there is no (integer) table with the prescribed constraints. Our construction lifts 
this situation to 2-marginals with no upper bounds: all entries of the unique corresponding 
nonnegative real array of size (3,4,6) with the 2-marginals in Figure ||| are {0, ^}-valued and 
there is no (integer) table with these constructed 2-marginals. 
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Figure 3: Derivation of Vlach's example from our construction. 



3 The table counting problem 



In this section we provide the proof of Theorem 1.2 discussed in Subsection 1.2. 



Proof of Theorem 1.2. As explained in Subsection 1.2, entry (1, 1) of the complexity table 
claimed by the theorem is easy, entry (2, 1) follows from Q, and entry (2, 2) follows from fll2|| . 

First, we prove entry (1,3) of the table, which implies at once entries (2,3), (1,4), (2,4) as 
well. We describe a direct reduction from Valiant's canonical #P-complete problem of comput- 
ing the permanent of a {0, l}-valued matrix [^7]] (recall that the permanent of an n by n matrix 
A is perm(^4) := J2 a 117=1 ^i,<r(i)> the sum extending over all permutations a of {1, ... , n}; for 
instance, the permanent of the adjacency matrix of a subgraph of the complete bipartite graph 
K ntn is the number of perfect matchings in that subgraph). 

Let then A be a {0, l}-valued n by n matrix the permanent of which is to be computed. 
Define 2-marginals for 3-tables of size (2, n, n) by 

v itjt+ := Aij , v i>+) i := v +)ji i := 1 , v i)+j2 := A i>+ - 1 , v +)j>2 := A +)j - 1 , l<i,j<n. 

Any 3-table x with these marginals is determined by its 2-subtable (a^iji) since for all i,j we 
have = Aij — x^i- Now, it is not hard to see that a nonnegative integer n by n matrix £ 
can arise as the subtable (^i,i,i) of a 3-table x with the constructed 2-marginals if and only if it is 
the standard representing matrix of a permutation a satisfying n?=i ^-i,a(i) = 1- Therefore, the 
permanent of A, which is the number of such permutations a, is precisely the number of 3-tables 
with the constructed 2-marginals, completing the reduction and the proof of entry (1, 3). 

Next we prove entry (1,2) of the table of Theorem |1.2| . Note that, as explained in the proof 
of Theorem |0], this implies the corresponding entry (1, 2) in the table of Theorem LI as well. 



So, r, c are fixed and we are given unary presented 2-marginals i>ij,+, Vi,+,k and u+j,k for 
3-tables of size (r, c, h). Let S be the set of all 2-tables s of size (r, c) satisfying the upper bounds 
Sjj < for all that is, dominated by the given "vertical" marginals. For k = 1, . . . ,h 
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define a matrix A k whose rows and columns are indexed by the elements of S, with entries 

, . _ J 1 if (t — s)i, + = v i>+jk for all i and (t - s) +:j = v + j k for all j , . 

otherwise s,t€i». ^ 

For p = 1, . . . , h let A p := j4i • A2 • ■ ■ ■ • A p be the product of the matrices A k , k = 1, . . . ,p. Let 
further I, u denote, respectively, the tables in S with entries lij := and Uij := i>ij,+ for all 

We claim that for any 1 < p < h and for any s,t E S, the number of 3-tables x of size 
(r,c,p) with x ii+} k = v ij+}k , x + j )k = v + j tk and x itjt+ = (t - s) iyj for 1 < i < r , 1 < j < c and 
1 < k < p, is precisely equal to the entry A p st of A p . In particular, the number of (r, c, /i)-tables 
with the given 2-marginals is given by A\ . Since r, c are fixed and the 2-marginals are presented 
in unary, the number n[=i IYj=i( v i,j,+ + 1) °f tables in 5 is polynomial in the size of the input 
and therefore the matrix A h and its sought entry A^ u can be computed in polynomial time. 

We prove the claim by induction on p. First, consider the case p = 1 and let s, t be any pair 
of tables of S. There is a unique (r, c, l)-array x satisfying Xij t \ — Xij t -^ = (t - s)ij for all i,j, 
and x is a table satisfying = and x+jjl = if and only if (t — s)i,+ = and 

(i — = V4. j 1 for all which by Equation |l| holds if and only if A\ t = (A\) s j = 1. 

Next, consider any 2 < p < h and suppose the statement is true for all values less than p. Let 
s, t be any pair of tables of S. Then any (r, c, p)-table x with a^-f^ = Vi t+ik , = v +i j >k and 

= (i — s)ij for all i, j, k is obtained, for some w £ S, by augmenting any of the Af" 1 tables 
y of size (r,c,p-l) with y i>+jk = v i>+>k , y +>jjk = v +>j>k and = (w-s) itj for all i, j, fc by any 
of the (Ap) Wt t tables z of size (r, c, 1) with = fj,+,p , = and = (t — 

for all Thus, the number of such tables is J2weS ■^w(^-p)w,t which is precisely A p st , proving 



the induction step and the claim, thus completing the proof of entry (1,2) and of Theorem 1.2 . □ 



4 The table entry-security problem 

In this section we provide the proofs of Theorems |ll] discussed in Subsections 1.3. 

Proof of Theorem |1.3| . Once again, as explained in Subsection 1.3, entry (1, 1) of the com- 
plexity table claimed by the theorem is easy and entry (2, 1) follows from [24]. We need to prove 
entry (1,3) which implies at once entries (2,3), (1,4), (2,4) as well, and entry (1,2). 

We begin with the proof of entry (1,3): we prove that both the lower and upper versions of 
the entry-security problem are hard. In fact, we prove stronger results by showing that each of 
the following special cases are already hard: (A) we reduce the table feasibility problem to the 
problem of deciding whether, given a feasible collection of 2-marginals, there is a 3-table with a 
specified entry equal to the minimal possible value zero; thus, even the special case of the upper 
version of the entry security-problem with U = is hard; (B) we reduce 3-dimensional matching 
to the problem of deciding whether, given a feasible collection of 2-marginals, there is a 3-table 
with a specified entry equal to the maximal possible value given by the Frechet upper bound 
(minimal value of the three 2-marginals involving this entry). Thus, even the special case of the 
lower version of the entry-security-problem with L the Frechet upper bound is hard. 

We being with part (A). Suppose then that we are given all the 2-marginals w+j,fc> v i,+,k 

for 3-tables of size (r, c, h), and we wish to know whether there is indeed a 3-table with these 
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2-marginals. Observe that the input 2-marginals can be assumed to be consistent; otherwise the 
2-marginals are infeasible. The 2-marginals given are Aij = Bj ^ = i>+j & and Q fe = Vi+,k- 

It is important to observe that Ya J2k C%,k = Ya J2j ^4,j = J2j J2k Bj t k = T. Note that T denotes 
the total sum of all entries on any 3-table that satisfies the input 2-marginals A, B, C. They 
also share the same 1-marginals (7^+ = Ai +,A+j = Bj + , and = All these equalities 

follow because the 2-marginals are consistent and will be useful later on. 

Now we will construct a feasible set of 2-marginals for a family of 3-tables R s ,t,u of size 
(r + 1, c+ 1, h + 1). The entry- value of a certain entry R St t,u can be used to decide whether the 
original set of 2-marginals A, B, C is feasible. We present the 2-marginals in Figure || as numbers 
on the surface of a 3-table. The three 2-marginals i?+,t,«, i? Sj + )U , R s ,t,+ are indicated by the 
coordinate directions in Figure ||. The reader can verify (see Figure ||) that the assignment is done 




Figure 4: The Construction of feasible 2-marginals from input 2-marginals. 



as follows: for 2-marginal R s ,+,u we set Ri,+,i = T, Ri,+,2 = C+,h, Ri,+,3 = C+,ft-ii • • • ^1,+,* = 
C+,h-t+2i ■ ■ ■ >Rl,+,h+l = C+,i- Similarly i?2,+,i = Cl,+> • • • > Rs,+,l = Cs-i,+> • • • Rr+1,+,1 — 
C r ,+- Finally, we have the assignment R s ,+,u = Cs-i,«-l f° r s = 2 . . . r + 1 and u = 2 . . . h + 1. 
Next for 2-marginal R s ,t,+ we have Ri,i,+ = T, Ri,2,+ = B± t+ , . . . , Ri,t,+ = Bt-i,+, . . . -Ri, c +i,+ = 
B c>+ , we also have #2,1,+ = Ci )+) . . . , # s ,i,+ = C s _i )+3 . . . i? r +i,i,+ = C r ,+, and i? Sjt ,+ = A s -i )t -i 
for s = 2 . . . r + 1 and i = 2, . . . c + 1. Finally for 2-marginal R+ t u we have that R + x,i = 7" and 
we set -R+,2,1 = ^4+,i) • • • ^+,t,l = A +tt -i, ■ ■ ■ R+,c+i,i = A + ^ c . Also from the picture we see that 
R+,i,2 = C+,h-, ■ ■ ■ R+,i,u = C +: h- u +2 ■ ■ ■ R+,i,h+l = C+,l and R+,t,u = for t = 2 . . . c+ 1 

and u = 2, . . . , /i + 1. 

Note that any such 3-table it! with the 2-marginals we wrote breaks up naturally into eight 
smaller 3-tables. We show the blocks 6(1), . . . , 6(8) in Figure |B| marking their dimensions. Ob- 
serve that block b(i) has a set of 2-marginals corresponding to it, i.e. those that come from 
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"projecting" the block in the directions s, t, u and the values are in the big 3-table #. We 
will use the blocks to explain how to fill in the entries of the 3-table and thus to prove that 
our construction gives indeed (1) a feasible set of 2-marginals and (2) the entry #i,ii, can be 
filled in with zero for some 3-table satisfying all 2-marginals if and only if the original set of 
2-marginals A,B,C is feasible. The notation we use in subsequent pictures to depict a way 
of filling a block is by writing either a single number (e.g. zero), which is used to filled all 
the block, or by listing a table (e.g. Cj p.) which indicates the entries of that table are copied 
down verbatim to be the entries of the block. Figure || shows a concrete 3-table which indeed 




i 



Figure 5: Blocks determined by the proposed 2-marginals. 



satisfies the 2-marginals given in the construction. More explicitly we fill the entries as follows: 
Block 6(1), a single entry #1,1,1 = T. Block b{2) has entries R\i u f° r u = 2, . . . ,h + 1, We 
fill them by #n |U = 0. Block 6(3) has entries R s ,i,i for s = 2, . . . ,r + 1. We fill them by 
#s,i,i = 0. Block 6(4) has entries R s ,i, u for s = 2..r + 1 and u = 2, . . . , h + 1. We fill them by 
Rs,i,u = Cs— Block 6(5) has entries R\,t,u f° r t = 2..C+1 and u = 2, . . . , h+l. We fill them 
by Ri t t,u = #t-l,u-l- Block 6(6) has entries R s ,t,i for s = 2..c + 1 and t = 2, . . . , r + 1. We fill 
them by R s ,t,i = ^.s-it-i- The entries of 6(7) and 6(8) are all zero. It is simple to verify is that 
all the axial sums agree with the totals stated in Figure |] because in the construction we used 
the 1-marginals of the 2-tables A,B,C as part of the 2-marginals and the data is consistent. 
This proves the first claim. Now we claim that the entry #1,1,1 takes on the value zero for some 
3-table R s ,t,u of size (r + 1, c + 1, h + 1) if and only if the 2-marginals A, B, C have a feasible 
solution. Let us assume that there is a 3-table R s ,t,u of size (r + 1, c + 1, h + 1) and i?i,i,i = 0. 
We divide the argument into two steps illustrated in the left-hand side of Figure ^: Note that 
if the entry #1,1,1 is zero we must have filled #2,1,1 = Ci,+> #3,1,1 = C*2,+, . . . ,#( r +i),i,i = Cc,+ 
and #1,1,2 = C+,i 5 • • • 1 #1,1,2 = C+,2j • • • #i,i,(ft+i) = C+,fc- The reason is 2-marginals #+,1,1 and 
#1,1,4- equal the total sum T, and T = J2 Ci y+ = This completes the filling of blocks 2 

and 3. Now, the marginals R s t+ an d R+,t,u attached to 6(4) imply that 6(4) is simply full of 
zeros otherwise we surpass the 2-marginals. This completes the first step of the argument. 

For the second step we refer to the right of Figure [7[ The marginal table R s ,+,u and the 
assignments so far for blocks 2 and 3 imply that only zero values can be put in the entries of blocks 
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Figure 6: A 3-table with the proposed 2-marginals. 




Figure 7: A 3-table with the proposed 2-marginals when #i i,i = 0. 



5 and 6, otherwise we surpass # s ,+, u . Now blocks 7, 8 are left to be decided. The 2-marginals 
corresponding to 6(8) indicate the entries of 6(8) are #1,2,1 = ^+,1 = #i,+> • • • ; #i,j,i = = 
Bj i+ , . . . #i,( c +i),i = A +)C = #c,+- Note that these are in fact the 1-marginals that follow from 
the input 2-marginals A,B,C. Finally, block 7 is the only block unfilled. Looking at the zeros 
that fill block 4, 5, and 6, we see block 7 is indeed a 3-table with 2-marginals A, B, C, and this 
ends the proof of the claim. Now conversely, and essentially following a reverse order, if there is a 
3-table with 2-marginals A, B, C we can put a copy of it as block 7. Then by the corresponding 
2-marginals we see 6(4), 6(5), 6(6) are filled with zeros. This forces #2,1,1 = Ci,+ ; #3,i,i = 
C2, +,•••) #(r+i),i,i = Cc,+ and #1,1,2 = C+,i) #1,1,2 = C+,2, • • • #1,1, (/1+1) = C+,h- This is 
because the 2 marginals #+,1,1 and #1,1,+ equal the total sum T and the 2-marginals # s ,+, u . 
Finally, the entry #1,1,1 is forced to be zero. This completes the proof of the part(A). 

Next we prove part (B). We reduce the 3-dimensional matching problem to the problem 
of deciding whether, given feasible 2-marginals, there is a slim 3-table with a specified entry 
attaining the Frechet upper bound. As mentioned in Section ||, the 3-dimensional matching 
problem is equivalent to the following problem: given a {0, l}-valued 3-table p = (pi,j,k) of size 
(n, n, n), is there a 3-table x = with all 1-marginals «£,+,+, u + j j+ , & equal to 1 which 

is dominated by p, i.e. satisfies the upper bounds Xij^ < Pi,j,k for all i,j, k ? given such data, we 
expand it to data for upper bounds and 1-marginals for 3-tables of enlarged size (n+1, n+1, n+1) 
as follows: we maintain the given upper bounds Pi t j,k an d the 1-marginals Uj. + , + , u+j + , u+ + k 
equal to 1 for 1 < i,j, k < n; we introduce the new upper bounds p n +i,n+l,n+l := 2n, Pij,n+l '■= 
Pi,n+i,k ■= Pn+i,j,k ■= for 1 < i,j, k <n, and Pi, n +i, n +i := p n +i,n+l,k '■= Pn+l,j,n+i '■= 1 for 1 < 
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k < n. Finally, the three new 1-marginals are introduced by u„ + i j+)+ := 2n, u_|_ )n+ i j+ := 2n, 
and u+ + n +l := In. The extended bounds are shown in Figure || on the union of the input 
(n, n, n)-table and seven other blocks. The extended 1-marginals and upper bounds are feasible: 




Figure 8: The entry bounds for 3-tables of size (n + 1, n + 1, n + 1). 



the (n + 1, n + 1, n + l)-table x defined by setting Xi, n +i,n+l '■= aJn+l,n+i,fc := ^n+lj,n+l := 1 for 
all 1 < i, j, k < n and zero in all other entries is feasible. 

Now consider any feasible extended table x: then it is not hard to see that its (n, n, n)- 
subtable (^i,j,fc)i'i * s feasible for the original data (coming from the input to the 3-dimensional 
matching) if and only if the entry x n+ \^ n+ i tn+ i equals the maximal possible value In. 

Now, we "lift" the situation to the problem with 2-marginals and no upper bounds in slim 
tables as follows: to the extended upper bound and 1-marginal data for (n+1, n+1, n+l)-tables, 
apply the transformation described in Theorem |1.4| (to be proved in the next section). This gives 
feasible 2-marginals for 3-tables of size (3, (n + 1) 2 , 3(n + 1)). By Theorem 1A, there is a feasible 
(n + l,n + l,n + l)-table x whose entry x n +i n +x n +i attains the maximal possible value 2n if 
and only if there is a feasible (3, (n + l) 2 ,3(n + l))-table y whose entry 2/i I ( n +i)( n +i) id om(n+l) 
attains the maximal possible value In. This completes the proof of part (B) and the proof of 



entries (1,3) and hence also entries and (2,3), (1,4), (2,4) in the table of Theorem 1.3 . 

Finally, we establish entry (1,2) in the statement of Theorem |1.3| : we present a polynomial 
time algorithm for deciding whether there is a 3-table x with specified 2-marginals whose entry 
x\ i i is in the range L < xn t i < U. The lower (respectively, upper) versions of the entry- 
security problem is the special cases of this entry-range problem obtained by taking U to be 
the Frechet upper bound U := min{ui j i t +, v l,+,l> (respectively taking L := 0). We use a 



simple modification of the algorithm for enumeration presented in the proof of Theorem 1.2 in 
the previous section; using the notation in that proof, we simply need to modify the definition 
of the first matrix A%, where for s,t G S, its (s, t)-th entry is now redefined to be 



(-4 



l)s,t 



1 if (t — s)j,-f = for all i, (t — s) + j = v + jj c for all j and L < (t — s)i t \ < U 

otherwise 



The other matrices remain as before. The entry A^ u of the product matrix now yields the 
number of tables with L < x\n < U and hence is nonzero if and only if such a table exists. □ 
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Multi-index transportation polytopes and the power of two- 
marginals 



We conclude with the proof of Theorem 1.4 discussed in Subsection 1.4 



Proof of Theorem |1.4| . The proof is based on an extension of the construction used in the 
proof of Theorem |1.1| . We provide the construction and an abridged form of the argumentation. 

Given 1-marginals (u + j )+ ), (u +:+t k) and entry upper bounds (Pij t k) for 3-tables of 

size (r,c,h), we define efficiently constructible 2-marginals (vij^), (vj, +,£,■), (f+j^) for 3-tables 
of size (3, rc,r + c + h) such that nonnegative real arrays y with these marginals are in integer 
preserving affine bijection with nonnegative real 3-arrays x of size (r, c, h) satisfying the given 
1-marginals and upper bounds, thus providing an isomorphism of the corresponding multi-index 
transportation polytopes and sets of tables of the two systems. 

As in the proof of Theorem |1.1| , (3, rc,r + c + /i)-tables will be indexed by triplets with 
the first index an integer 1 < t < 3, the second index an ordered pair ij with 1 < i < r and 
1 < j < c, and the third index three-letter abbreviation gro € {dom, row, co i} along with a numerical 
index 1 < k < h. Let U denote the minimal of the two values max{iii t +^ : 1 < i < r} and 
max{ii +) j j+ : 1 < j < c}. The 2-marginals are provided by the following three matrices. 
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+ ,grokj 




u+,c,+ r-U- n +iCj+ / 



We make use again of a partition of (3, rc, r + c + /i)-arrays into blocks similar to Figure ffl. 
First consider any nonnegative real (r, c, /i)-array x satisfying the given 1-marginals and upper 
bounds. We show it uniquely extends to a nonnegative real (3, rc, r + c + /i)-array with 2- 
marginals as above. Given then such an array x, embed it in the black block (l,dom) of a 
(3, rc, r + c + /i)-array y by yi^j^omk := x i,j,fc f° r an hJik- We now show that the block x 
can be uniquely extended to a whole nonnegative real (3, rc,r + c + /i)-array y with the above 
2-marginals. First, the entries in the grey blocks (l, co i), (2, row) and (3, dom) in Figure |] 
are all zero since so are the 2-marginals u lt+)COl As = f2,+, r0 wfc = ^3,+,domfc = for all k. Next, 
consider the entries in the white block (l,row): using the fact that all entries in the block 
(l,coi) below it are zero, and examining the 2-marginals u+yrowjfe and = U, we find that 

yi,ij^mi = U - J2k=i Vi,ij,d 0m k = U - x i; j )+ > whereas for k ^ i we have yi,f/, ID wfc = 0. This 
also yields the entries in the white block (3, row): we have y3,ij (Iow j = U — yi ; ij liaw i = > 

whereas for k ^ i we have y3 t ij, TOW k = 0- Next, consider the entries in the white block (2, dom): 
using the fact that all entries in the block (3, dom) to its right are zero, and examining the 
2-marginals v +)i j )6om k = Pi,j,k we fin d tnat V2,ij,domk = Pi,j,k ~ %ij,k > for all i,j,k. Next 
consider the entries in the white block (2,coi): using the fact that all entries in the block 
(2, row) above it are zero, and examining the 2-marginals v+ jj cdfc and V2 ij + = Pi.j,+, w e find 
that y2,ij,coij = Pi,j,+ ~ Efe=i y2,ii,domfc = Xij,+ > whereas for k ^ j we have y 2 ,ij,coifc = 0. This 
also yields the entries in the white block (3, coi): we have y3 t ij jCO ij = U — 2/2,17,001 j = U—Xij„ + > 
whereas for k 7^ j we have 2/3,ij )C oi fc = 0- 

Next consider any nonnegative real (3, rc,r + c + /i)-array y with the above 2-marginals, and 
let x be its (r, c, /i)-subarray given by the black block (l,dom) of y, defined by Xij^ : — yi,ij,domk 
for all i,j,k. We show that x is nonnegative and satisfies the given upper bounds and 1- 
marginals. It is nonnegative since so is y. It is dominated by p since, for all k we have 
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Pi,j,k ~ Xi,j,k = y2,ij,domk > 0. Finally, it obeys the 1-marginals «,,+,+, u +tjj+ and u +i+ifc since: 

,ij } dom 

3 

X + ,3,+ = ^2V2,ij,colj 

i 

Thus, the set of nonnegative real (r, c, /i)-arrays x satisfying the given upper bounds and 1- 
marginals is in integer preserving affine bijection with the set of nonnegative real (3, rc,r+c+h)- 
arrays y with the constructed 2-marginals. In particular, the corresponding multi-index trans- 
portation polytopes and sets of tables of the two systems are isomorphic, completing the proof. □ 



= «l, + ,domfc = U+, + ,k , 1 < k < h 

= «3,+,rowi = Ui,+,+ i I <i<r ; 
= v 2 ,+, colj = u +:jt+ , 1 < j < c . 
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